Why Quantification Using Survey Spectra Can Sometimes Be Misleading